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Abstract 


it  is  conjectured  that  a good  cognitive  psychology  theory  will 
lead  to  0 good  artificial  intelligence  (AI)  progran.  Tf  this  is  true^ 
there  sirould  be  a convergence  of  psyciKilogical  and  Al  considerations  in 
theory  construction.  This  convergence  is  illustrated  in  terms  of  ACT, 
a computer  simulation  model  of  cognitive  processes.  Separate  AI  and 
psychological  consiuerations  are  used  to  motivate  the  decision  to 
design  ACT  as  a production  system  operating  on  an  associative  network 
data  base.  Similar  motivation  is  provided  for  other  features  of  ACT 
implemented  within  this  framework.  These  features  include  the  use  of  a 
propositional  structure  for  the  associative  network,  a spreading 
activation  process  operating  on  the  network,  the  simulated  ability  to 
execute  several  procedures  in  parallel,  and  the  use  of  strength 
measures  to  select  among  competing  productions  and  competing  paths  in 
the  network. 


We  hnve  been  working  on  a production  system  model  of  hunan 
cognition  -i-lli-o  ACT.  An  earlier  version  of  tlie  ACT  system,  calle'l 
rtOlt,  IS  descf  ib(d  in  Anderson  [ [ •^  1] , Anaersori,  Kline,  and  Lewis  [fb)', 
r.nd  Kline  .ind  Anoerson  [L21]J.  That  system  h.js  been  used  to  develop 
mini-models  for  retrieval  from  memory,  inference  making,  language 
comprehension,  question-answering,  and  problem  solving.  We  are 
currently  working  on  a new  version  of  ACT  called  ACTF.  This  paper 
discusses  a nunber  of  the  design  decisions  underlying  the  ACT  system. 

We  will  discuss  how  these  design  decisions  are  motivated  by  both 
psychological  and  artificial  intelligence  (AT)  considerations. 

[What  is  ACT?] 

ACT  is  at  the  same  time  a high-level  programming  language  and  a 
theory  of  the  cognitive  mechanisms  underlying  hunan  information 
processing.  A high-level  programming  language  is  a formalism  that 
facilitates  programming  certain  kinds  of  algorithms.  However,  it  may 
also  be  difficult  to  program  algorithms  other  than  the  intended  kinds, 
so  that  high-level  programming  languages  are  often  "special-purpose". 

AC'l  IS  a special-purpose  programming  language  in  this  sense.  But  the 
fact  that  certain  processes  or  algoritlms  can  be  coded  in  ACT  more 
efficiently  and  easily  than  others  is  the  means  by  wliich  ACT  provides  a 
theory  of  the  cognitive  mechanisms  that  underlie  human  information 
processing.  Humans  are  also  more  successful  at  certain  cognitive 
processes  than  others.  Tlie  hope  is  that  ACT  limitations  correspond  to 
him.#)  limitations.  If  this  is  so,  psychological  theories  of  specific 
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cognitive  behaviors  automatically  acquire  a certain  face  validity  when 
embodied  as  programs  in  the  ACT  programming  language. 


Given  the  adaptiveness  and  flexibility  of  himan  cognition  no 
stcitic  ACT  progfein  can  serve  as  an  adequate  psychological  model . ACT 
must  have  the  capability  for  evolving  new  programs  and  our  current  work 
is  focused  on  developing  a learning  program.  However,  space 
limitations  do  not  permit  us  to  discuss  this  learning  work,  we  will 
confine  the  discussion  to  the  principles  by  which  ACT  programs  are 
interpreted  and  executed. 

[A  Relationship  Between  Psychology  and  All 

Wo  conjecture  that  there  is  a strong  relationship  between 
cognitive  psychology  and  those  AI  efforts  concerned  with  developing 
general  and  adaptive  systems.  (This  is  what  we  will  mean  by  AI  for  the 
remainder  of  this  paper.)  This  conjecture  can  be  stated  as  follows: 

Good  cognitive  psychology  is  good  artificial  intelligence.  (1) 

The  majority  of  this  paper  will  be  devoted  to  illustrating  how  belief 
in  this  principle  has  influenced  the  design  of  the  ACT  system. 
However,  first  we  would  like  to  discuss  the  implications  of  this  claim. 

What  exactly  does  it  mean?  By  "good  psychology"  we  mean  a 
theory  that  meets  four  scientific  criteria:  parsimony,  effectiveness, 
broad  generality,  and  empirical  accuracy  (see  [[313  for  a discussion  of 
these).  Of  principal  importance  to  our  points  are  the  criteria  of 
effectiveness  and  empirical  accuracy.  Effectiveness  refers  to  the 
constraint  that  the  theory  be  specified  well  enough  that  predictions 
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can  be  rigorously  derived  from  it.  The  important  consequence  of 
effectiveness  is  that  a computer  simulation  of  the  theory  can  be 
produced  . By  empirical  accuracy  we  mean  that  it  successfully  predicts 
human  behavior  in  various  cognitive  tasks.  Thus  by  conjecture  (1)  we 
mean  that  the  computer  simulation  of  a psychological  theory  that 
successfully  accounts  for  empirical  data  will  be  translatable  into  a 
good  AI  program.  By  a good  AI  progran  we  mean  one  that  produces 
intelligent  behavior  under  reasonable  constraints  of  computational 
efficiency.  Since  a good  psychology  program  will  mimic  human  behavior, 
a reasonable  standard  of  intelligence  is  guaranteed.  The  non-obvious 
aspect  of  our  conjecture  concerns  the  matter  of  computational 
efficiency. 

If  conjecture  (1)  is  true,  one  way  to  attempt  AI  is  to  develop 
a program  that  models  psychological  data.  Note,  however,  we  are  not 
claiming  that  this  is  the  only  way  to  develop  a good  AI  theory. 
Moreover,  we  are  explicitly  not  endorsing  the  claim  that  an  AI  program 
must  meet  standards  of  good  psychology.  That  is,  we  are  not  claiming: 

Eiad  cognitive  psychology  is  bad  artificial  intelligence,  (2) 
rKjr  its  contrapositive  equivalent: 

Good  artificial  intelligence  is  good  cognitive  psychology.  (3) 

Claim  (3)  has  been  put  forward  (but  not  endorsed)  by  Newell 
[[25]]  as  a possible  relationship  between  AI  and  psychology.  It  has  been 
endorsed  informally  by  a nimber  of  workers  in  AI.  (We  wonder  if  its 
endorsers  were  aware  of  its  equivalent  contrapositive  (2)  which  would 


make  ull  AT  endeavors  subject  to  psychological  test.)  The  argiment  for 
(j)  is  that  the  feats  of  hunan  intelligence  are  so  difficult  that  there 
is  essentially  only  one  way  of  accampllshing  them  on  any  physical 
device  including  a hunan  brain  or  a serial  computer.  While  what  is 
meant  by  "essentially  only  one  way'*"  is  uncertain,  we  feel  the  claim  is 
implausible.  We  find  this  claim  implausible  in  light  of  the  non- 
identifiability  results  in  psychology  [[3]]t  the  behavioral  equivalences 
among  different  machines  in  automata  theory,  the  existence  of  very 
different  programs  to  perform  a range  of  functions  from  sorting  to 
parsing,  and  the  observation  that  nature  has  evolved  different 
mechanisms  to  serve  the  same  function. 

So,  we  feel  there  are  different  routes  to  the  goal  of  good  AI, 
only  some  of  which  involve  psychological  theories.  For  example,  there 
would  be  nothing  wrong  with  an  AI  program  that  found  it  easier  to 
analyze  a sentence  than  a picture,  but  there  would  be  somethirg  wrong 
with  a psychological  theory  that  did.  However,  it  is  a fac  th  there 
is  no  current  AI  program  that  begins  to  meet  the  criteri  cf  broad 
generality  and  adaptivity.  Thus,  while  there  may  be  many  ways  to 
achieve  a good  AI  program,  it  clearly  is  proving  difficult  to  discover 
any  of  these  ways.  Thus,  while  it  is  not  necessary  for  the  AI  worker 
to  follow  psychological  research  in  designing  his  systems,  it  might 
prove  to  be  a good  heuristic  in  trying  to  search  for  a'  ec'jcMate 
prog ran. 

The  implications  of  conjecture  (1)  about  the  re) ntion 'nip 
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between  psych>ology  and  AI  are  not  one-sided.  This  can  be  seen  by 
considering  the  contrapositive  of  (1): 

B.'id  artificiai  intelligence  is  bfxi  cognitive  psychology.  (*4) 

This  places  a new  constraint  on  a psychological  theory.  It 
must  be  translatable  into  a good  AI  progratn.  In  particular,  the 
implementation  of  a theory  must  obey  certain  constraints  on 
computational  efficiency.  For  instance,  a theory  of  language 
processing  would  be  judged  inadequate  if  its  best  simulation  produced 
comprehension  times  that  were  exponential  functions  of  sentence  lengths 
or  which  required  exponentially  increasing  computational  space. 

We  think  complexity  functions  are  better  measures  of 
computational  efficiency  than  are  absolute  amounts  of  computation  space 
or  time.  Judgments  about  what  is  an  acceptable  absolute  amount  are 
determined  by  current  machine  capabilities.  It  would  be  silly  to 
cripple  our  psychological  theory  because  current  machine  capabilities 
do  not  match  those  of  the  hunan  brain.  It  would  be  particularly  silly 
given  the  rtdSonable  expectation  that  current  limitations  will  be 
exceeded  by  many  orders  of  magnitude  over  the  next  decades. 

However,  evaluating  the  efficiency  of  an  algorithm  in  terms  of 
complexity  functions  is  not  without  its  problems  either.  Complexity 
functions  make  no  allowances  for  the  fact  that  often  only  a restricted 
range  of  complexities  are  encountered  in  a practical  problem.  AI 
programs  employing  algorithms  with  superior  performance  on  this 
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T’-stricLeo  rutige  '.ould  be  preferred  even  if  the  asymptotic  performance 
ol  those  algorithms  was  very  poor. 

With  suitable  allowances  for  this  probltm  with  complexity 
luriLlions,  wo  miglit  understand  (1)  and  ('0  js  asserting  that  a good 
psychology  program  will  employ  algorithms  wliich  are  character izod  by 
reasonable  complexity  functions.  But,  there  are  still  problems. 
Suppose  our  best  simulation  predicted  that  a certain  process  took  an 
exponentially  increasing  imount  ol  time  as  a function  of  problem 
complexity,  lhat  would  not  be  unacceptable  if  it  could  be  shown  that 
the  best  known  computer  algorithm  also  displayed  this  complexity 
function  and  that  hirian  processing  time  increased  exponentially  with 
problem  complexity.  It  is  also  the  case  that  human  behavior  often 
displays  a poorer  complexity  function  than  the  best  known  algorithm. 
For  instance,  consider  the  time  it  takes  humans  to  identify  a concept 
in  a concept- identification  task  [[17]].  Their  identification  times  are 
often  litiCc-r  in  the  number  of  possible  hypotheses  rather  than 
logarithmic.  However,  humans  can  be  trained  to  implement  a logarthmic 
algoritlm.  Thie  upshot  of  these  qualifications  is  that  (1)  and  (U) 
amount  to  thie  requirement  that  the  best  algorithm  implementable  in  a 
psychological  theory  like  ACT  display  the  best  possible  complexity 
function  on  a serial  computer.  We  would  conjt“Cture  that  humans  are 
capable  of  achieving  this  some  complexity  function  after  suitable 
training. 

Now  that  we  finally  understand  v^liat  (1)  and  (*4)  should  be  taken 
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to  mean,  vve  see  that  for  (1)  and  (4)  to  be  valid  the  human  brain  and 
the  serial  computer  must  be  subject  to  the  same  complexity  constraints. 
That  is,  if  either  computing  device  can  employ  algorithms  whose 
complexity  functions  arc  unattainable  by  the  algorithms  available  to 
the  other,  (1)  and  (4)  will  probably  be  false. 

The  fact  that  humans  can  hand  simulate  computer  programs 
suggests  that  the  brain  is  not  at  a disadvantage  in  this  respect.  On 
the  other  hand,  we  know  of  no  physically  realizable  computational 
device  (the  brain  included)  that  achieves  better  complexity  functions 
than  the  serial  computer  #2. 

Thus  barring  the  discovery  that  the  brain  has  fundamentally 
superior  computational  abilities,  (1)  and  (4)  would  appear  to 
characterize  the  relationships  between  good  psychology  and  good  AI.  If 
this  characterization  is  accurate,  there  is  potential  for  fruitful 
interaction  between  the  two  disciplines.  The  remainder  of  this  paper 
will  discuss  how  AI  considerations  and  psychological  considerations 
converge  in  the  case  of  the  ACT  program. 

[Propositional  Network] 

The  data  base  in  ACT  is  a propositional  network.  A 
propositional  network  is  an  associative  network  structured  so  it  can  be 
divided  into  units  having  a propositional  status.  There  has  been  some 
concern  whether  associative  networks  have  adequate  expressive  power 
(cf.,  [[35]]).  However,  in  conjunction  with  the  production  system  it  can 
be  shown  that  ACT  has  expressive  power  at  least  equivalent  to  the 
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predicate  calculus  [[3]1*  The  condition  of  an  ACT  production  specifies 
network  configurations  that  must  be  present  or  absent  for  the 
production  to  apply.  The  execution  of  an  ACT  production  can  cause  new 
propositions  to  be  built  in  memory  and  old  propositions  to  be  modified. 

■Die  associative  network  structure  of  ACT  is  such  that  each 
concept  indexes  all  the  propositions  it  occurs  in.  The  structure  is 
double- linked  so  it  is  possible  to  go  both  from  concept  to  proposition 
and  Irom  proposition  to  concept.  This  associative  indexing  feature  of 
ACT  nicely  illustrates  the  convergence  of  psychological  and  AI 
considerations.  There  is  a large  amount  of  data  indicating  some  sort 
of  associative  structure  in  memory.  A simple  phenomenon  is  that  of 
word  association:  Take  a word,  generate  a semantic  associate  to  it, 
take  that  word  and  generate  an  associate  to  it,  and  so  on.  For 
instance,  starting  with  dog:  dog-bark-hear-ear-organ-body-weight-scale- 
step-foot-ball-etc . The  obvious  way  to  simulate  such  free  association 
protocols  (cf.,  [[20]]  ) is  by  a search  process  over  an  associative 

network.  The  computational  advantage  of  associative  indexing  is  also 
well  understood.  It  serves  to  make  time  to  retrieve  a fact 
approximately  independent  of  the  nunber  of  facts  in  the  data  base. 

There  are  also  converging  arguments  for  imposing  a 
propositional  structure  on  the  data  base  rather  than  some  simpler 
associative  structure.  Most  AI  prograns  that  have  performed 
inferential  reasoning  have  used  proposition-like  representations  of 
information.  The  reason  is  that  a propositional  structure  abstracts 
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out,  .jfia  nukes  So  lent  aspects  of  the  information  relevant  for  deciding 
tht  validity  (or  plausibility)  of  inferences. 

There  are  ntmerous  sources  of  psychological  data  supporting  the 
concept  of  propositional  organization.  For  instance,  there  is 
considerable  evidence  (e.g.,  [[6,  U,  16]])  that  propositions  tend  to 
be  forgotten  as  units.  That  is,  the  conditional  probabilities  are  high 
that  if  one  element  of  a proposition  is  forgotten  the  remainder  will 
also  be  forgotten.  While  subjects  do  occasionally  recall  only  partial 
propositions  (e.g.  "The  hippie  touched  somebody  but  I can't  remember 
who.")  such  reports  are  statistically  rare.  There  is  also  considerable 
evidence  (e.g.,  [[28,  32]])  that  subjects,  in  remembering  sentential 

information,  often  do  not  remember  the  exact  wording  of  Uhal  was  said 
but  only  the  propositional  content. 

[Spreading  Activation] 

The  concept  of  spreading  activation  has  been  quite  popular  in 
cognitive  psychology  (Collins  & Loftus,  1975;  Collins  & Quillian,  1972; 
Kieras,  1977).  There  is  an  activation  process  that  operates  on  the  ACT 
network.  Particular  nodes  can  be  activated  either  by  stimulation  from 
environmental  events  or  by  execution  of  production  actions.  With  the 
passage  of  time  activation  spreads  from  the  source  nodes  to  associated 
structures.  Productions,  in  matching  their  conditions,  can  only 
inspect  the  active  portion  of  memory.  Therefore,  this  activation 
process  serves  to  focus  attention.  There  are  also  mechanisms  in  ACT 
which  deactivate  all  the  structure  that  has  been  activated  by  a source 
when  that  source  loses  its  activation. 
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A spreading  activation  process  was  suggested  by  Quillian  [[27]]. 
There  is  considerable  physiological  evidence  for  an  associative  spread 
of  excitation  through  the  nervous  system  [[29]].  Tliere  is  also 

considerable  behavioral  data  pointing  to  the  utility  of  the  concept 
[[j,  11]].  For  instance,  subjects  can  be  slowed  in  deciding  a 

proposition  is  false  if  there  is  an  irrelevant  connection  among  the 

elements  of  the  proposition  (e.g.,  Madrid  is  in  Mexico,  see  [[11]]).  In 

other  circumstances  such  irrelevant  connections  can  facilitate 

processing  [[23]].  Such  effects  indicate  a diffuse  activation  process 
that  is  priming  all  connections,  relevant  or  not. 

It  seems  that  Quillian' s spreading  activation  notion  has  not 
received  much  acceptance  in  the  AI  community  (see  [[2<4,  3^]1  for 

criticisms).  It  is  computationally  expensive  to  compute  a spread  of 
activation.  In  fact,  in  our  own  simulation  we  have  found  it  too 
expensive  to  simulate  faithfully  the  conceptual-neural  model  we  would 
want  to  endorse.  Rather  we  approximate  this  with  a much  quicker 
activation  process.  We  suspect  that  it  is  the  cost  of  the  activation 
computation  that  accounts  for  the  infrequency  of  its  use  in  AI.  By 
application  of  (^1)  we  might  be  tempted  to  conclude  that  the  conceptual- 
neural  model  is  bad  cognitive  psychology.  However,  this  problem  with 
spreading  activation  may  reflect  only  current  computational  limits. 
Given  faster  processors  and  the  prospect  of  parallel  computation,  we 
suspect  that  efficiency  objections  to  the  conceptual-neural  model  will 
bt  less  serious  with  passing  years. 
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The  ccxnputiitiotieji  function  of  the  activation  process  within  ACT 
is  to  enable  us  to  run  a pattern-evoked  production  system  in  a 
propositional  network  but  to  avoid  linear  (or  worse)  growths  in  the 
iimount  of  computation  time  with  the  size  of  the  data  base  or  the  nunber 
of  productions.  This  is  achieved  in  two  ways.  First,  the  activation 
process  serves  to  limit  the  amount  of  structure  needing  to  be  searched 
in  determining  whether  the  condition  of  a nominated  production  matches. 

Second,  productions  are  nominated  for  consideration  by  the 
activation  process.  Associated  with  each  node  is  a list  of  productions 
that  make  reference  to  that  node.  When  that  node  is  activated  these 
productions  are  considered.  Since  the  nunber  of  nodes  that  are  active 
is  independent  of  the  total  nunber  of  productions,  under  this  scheme 
the  growth  of  computation  time  with  number  of  productions  will  depend 
on  the  average  number  of  productions  that  are  associated  with  any  given 
node.  Newell  (personal  communication  — see  also  [[22]])  has  argued  that 
in  realistic  problem  domains  the  number  of  productions  tends  to 
increase  more  rapidly  than  the  number  of  data  base  elements.  If  this 
were  true  of  ACT,  there  would  be  an  increase  in  the  production  to  node 
ratio  with  growth  in  the  size  of  the  system.  Newell  has  observed  from 
simulations  that  this  increase  in  the  ratio  is  approx imateli 
logarithmic  with  the  number  of  productions.  We  would  regard  a 
logaritlmic  complexity  function  as  acceptable. 

The  activation  process  basically  serves  to  limit  the  amount  of 
data  that  the  system  has  available  at  any  one  time.  Therefore,  it  is 
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important,  to  the  operation  of  the  system  that  the  currently  available 
set  of  data  not  be  just  randomly  selected  but  rather  be  associated  to 
those  source  nodes  the  system  is  currently  focused  on.  These  are  the 
currently  relevant  data.  For  instance,  when  a word  is  heard  it  is  made 
a soiree  node,  activation  spreading  from  that  node  will  activate 
syntactic  and  semantic  information  needed  for  its  comprehension. 

While  the  utility  of  activating  the  associative  surround  of 
items  in  focus  is  clear,  the  utility  of  stretching  out  this  activation 
process  over  time  may  not  be  so  obvious.  Why  not  immediately  activate 
all  the  structure  that  is  going  to  be  activated?  The  spreading  process 
allows  ACT  to  focus  first  on  those  data  most  likely  to  be  relevant,  and 
to  try  less  relevant  data  later.  Thus,  the  spreading  process  allows 
the  system  to  "bet”  its  limited  computational  resources  on  what  is  most 
promising  first. 

This  is  facilitated  by  having  strengths  associated  with  network 
links.  The  strength  of  a link  reflects  how  frequently  and  recently  it 
has  been  involved  in  successfully  matching  the  condition  of  a 
production.  In  the  spread  of  activation,  the  total  anount  of 
activation  energy  at  a node  is  divided  among  the  links  emanating  from 
that  node.  The  amount  of  energy  given  to  a link  is  a function  of  its 
strength  relative  to  the  strength  of  all  links.  The  rate  at  which 
activation  will  spread  down  a link  to  activate  structures  connected  to 
the  link  is  a function  of  this  amount  of  energy.  This  means  the 
structure  that  tends  to  be  more  rapidly  activated  is  the  structure  that 
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has  more  often  proven  useful  in  matching  productions.  This,  of  course, 
is  a computationally  sensible  criterion  for  ordering  the  activation  of 
structure.  It  is  also  a well  documented  psychological  fact  [[3,  *<]] 
that  subjects  can  retrieve  more  quickly  information  which  they  have 
used  often. 

This  strength  mechanism  is  also  responsible  for  forgetting  in 
ACT.  Forgetting  of  information  occurs  when  the  links  encoding  a 
structure  become  so  weak  relative  to  competing  links  that  it  becomes 
effectively  impossible  to  reactivate  the  structure.  This  implies  that 
forgetting  is  due  to  competition  by  interfering  information — one  of  the 
most  well-docunented  facts  about  human  memory  [[4]]. 

[Virtues  of  Production  Systems] 

Production  systems  by  now  are  a familiar  AI  formalism  and  there 
are  discussions  available  of  the  advantages  that  they  offer  (cf., 
[[14]]).  Therefore  we  will  focus  mainly  on  the  advantages  production 
systems  provide  as  a psychological  theory  and  on  those  aspects  of  the 
ACT  production  system  that  are  unique.  A striking  similarity  has  been 
noted  [[3,  26]]  between  production  systems  and  other  stimulus- 
response(5-R)  theories  in  psychology.  The  connection  between  condition 
and  action  is  quite  similar  to  the  S-R  connection.  There  have  been  a 
series  of  psychological  critiques  of  S-R  theory  [[3,  4, 

8,  10,  18]].  These  critiques  have  basically  been  aimed  at  the 
computational  power  of  the  S-R  formalism.  It  has  been  shown  [[18]]  that 
at  least  certain  versions  of  S-R  models  do  not  have  the  computational 
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power  of  finite  stole  machines.  However,  production  systems  circunvent 
these  limitations  by  use  of  variables,  patterns,  and  memory  [[3]]* 
Thus,  production  systems  can  be  seen  as  having  some  of  the 
psychological  advantages  of  S-R  theory  without  forfeiting  computational 
power.  The  positive  features  of  production  systems  discussed  below  are 
also  true  of  S-R  theories. 

[Data-  Driven  Character] 

One  of  the  important  features  of  production  systems  is  their 
data-driven  character.  In  each  cycle  of  the  production  system  there 
must  be  a reevaluation  of  the  consequences  of  the  current  knowledge 
state  for  the  control  of  behavior.  Thus  information  that  comes  in  and 
changes  the  knowledge  state  can  have  immediate  effects  on  behavior. 

The  survival  advantages  of  a data-driven  processing  system  for  humans 
are  obvious.  There  is  also  evidence  that  human  cognition,  even  when 
survival  is  not  at  stake,  operates  in  a strongly  data-driven  mode.  For 
instance,  the  work  on  chess  [[9,  26 ]J  indicates  chess  masters  do  much  of 
their  intellectual  work  by  means  of  pattern  recognition,  and  that  chess 
masters  usually  perceive  the  correct  move  within  a few  seconds  of 
scanning  the  board.  It  has  been  argued  that  chess  masters'  knowledge 
of  board  positions  can  be  prop«>rly  modeled  by  a large  production  system 
where  individual  productions  contain  board  configurations  as  condition- 
patterns  and  appropriate  responses  (often  moves)  as  actions. 

[Unity  of  Control  and  Data  Store] 

One  of  the  central  features  of  production  systems  is  their  lack 
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of  distinction  between  the  mediun  that  stores  control  information  and 


the  mediun  that  stores  data.  Unlike  most  progranning  languages  there 
are  no  special  facilities  for  storing  control  information — no  separate 
progran  counter,  pushdown  stack,  etc.  All  control  information  must  be 
stored  in  the  same  data  base  (e.g.,  in  Newell's  PS  this  is  STM,  in  ACT 
it  is  the  propositional  network)  that  serves  to  store  the  input  and 
results  of  computations. 

Intuitively,  it  seems  compelling  to  us  that  unity  of  control 
and  data  is  a feature  of  human  cognition.  Fortunately,  we  do  not  have 
to  rely  just  on  intuition.  There  is  some  psychological  data  supporting 
this  assunption.  A variety  of  experiments  have  looked  for  a trade-off 
between  the  size  of  the  immediate  memory  span  and  the  computational 
complexity  of  an  on-going  task  [[7,  13,  30,  3313 • For  instance.  Wanner 
and  Maratsos  [[3333  had  subjects  hold  a set  of  words  in  memory  while  the 
subjects  tried  to  comprehend  sentences  of  various  syntactic  complexity. 

In  the  ATN  model  they  were  testing,  this  complexity  translated  into 
amount  of  control  information  that  had  to  be  held.  (It  would  translate 
into  amount  of  control  information  in  most  computational  models.)  They 
found  subjects  were  able  to  recall  fewer  of  the  words  when 
comprehending  sentences  of  greater  syntactic  complexity,  and  hence 
requiring  more  control  information.  This  trade-off  between  the  amount 
of  information  in  memory  span  and  the  cxnount  of  control  information  is 
typical  of  the  research  results  in  this  area.  The  hypothesis  that  there 
is  one  storage  mediun  for  data  and  control  information  predicts  this 
combined  storage  limitation. 


16 


Our  feeling  is  that  the  use  of  a single  representational 
formalism  for  control  information  and  all  other  data  has  advantages  for 
a system  that  is  to  acquire  and  modify  productions.  The  role  of  an 
individual  production  in  the  overall  flow  of  control  becomes  more 
apparent,  and  this  comprehensibility  should  be  as  much  of  an  advantage 
for  a learning  system  which  must  make  decisions  about  the  function  of  a 
particular  production  as  it  is  for  a himan  programmer.  The  structure 
of  productions  and  their  rules  of  interpretation  are  also  considerably 
simplified  if  there  is  no  distinction  between  control  information  and 
other  data,  and  this  simplicity  is  also  an  advantage  for  production 
acquisition. 

Unfortunately,  while  production  systems  tend  not  to  make  a 
formal  distinction  between  control  and  data,  in  practice,  one  often 
finds  an  implicit  distinction  made  by  the  programs  written  within 
production  systems.  This  is  seen  in  the  use  of  special  control 
conventions  in  order  to  achieve  the  same  sequential  execution  of 
functions  found  in  conventional  programming  languages.  Although  some 
of  our  earlier  work  in  ACT  had  made  extensive  use  of  such  control 
conventions,  we  are  currently  trying  to  avoid  them  because  they  forfeit 
some  distinct  advantages  of  production  systems. 

[Modularity] 

Another  important  feature  of  production  systems  is  the 
modularity  of  the  individual  productions.  Because  each  production 
makes  reference  to  a data  base  common  to  all  productions  and  because  no 
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prcxluction  makes  reference  directly  to  other  productions,  individual 
productions  tend  to  be  independent  of  one  another.  That  is,  if  a 
particular  production  is  added,  deleted,  or  changed,  the  basic 
performance  of  the  system  tends  to  remain  relatively  unaffected.  We 
feel  that  claims  about  the  modularity  of  production  systems  have  been 
sometimes  exagerated.  There  can  be  production  systems  designed  such 
that  the  change  of  one  production  would  have  disastrous  effects  on  the 
system.  However,  in  a sense  such  production  systems  reflect  "bad 
programing  style."  Production  systems  should  be  constructed  to 
maximize  the  modularity  of  individual  productions. 

The  advantage  of  modularity  to  the  comprehensibility  of  the 
system  is  obvious.  The  advantage  of  modularity  to  the  development  of  a 
learning  system  capable  of  self-extension  is  equally  obvious.  The 
basic  modularity  of  hunan  information  processing  is  attested  to  by  the 
gradual  development  of  our  processing  abilities  and  by  the  fact  that 
new  skills  almost  never  have  disastrous  interactions  with  old.  (Of 
course,  these  facts  about  hunan  modularity  could  be  produced  by 
formalisms  other  than  production  systems.) 

[Parallelism] 

There  are  a nunber  of  places  in  ACT  where  we  have  found  it 
useful  to  simulate  parallel  computation.  As  discussed  above, 
activation  is  conceived  of  as  spreading  simultaneously  from  all  active 
nodes  to  the  associated  network  structure  and  in  the  process,  selecting 
the  productions  that  reference  these  nodes  for  further  testing.  Not 
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only  does  ACT  select  in  parallel  among  a large  set  of  productions  on 
each  cycle,  it  is  also  the  case  that  on  each  cycle  ACT  simulates  the 
ability  to  apply  (test  and  execute)  a nunber  of  productions  in 
parallel.  The  evidence  is  quite  compelling  that  hunans  can  carry  along 
a nunber  of  processes  in  parallel.  For  instance,  consider  the  well- 
worn  example  of  being  able  to  hold  a conversation  and  drive  at  the  same 
time.  We  have  found  parallel  procedures  useful  in  language  processing 
[[5]].  In  comprehending  a sentence  one  must  perform  a large  nunber  of 
operations — mjike  perceptual  judgments  about  words,  switch  attention 
from  word  to  word,  perform  syntactic  analysis,  perform  semantic 
analysis,  resolve  pronominal  references,  recognize  the  referents  of 
definite  descriptions,  perform  inferences,  etc.  It  is  implausible  that 
each  of  these  operations  occupies  separate  segments  of  time  with 
control  switching  among  them.  It  is  much  more  intuitively  plausible  to 
suppose  that  these  various  linguistic  processes  proceed  in  parallel. 

While  we  do  allow  ACT  to  pursue  more  than  one  process  in 
parallel,  there  is  a capacity  limitation  on  how  much  can  be  computed  in 
parallel.  There  is  a probabilistic  parameter  that  places  a maximun  on 
the  mean  nunber  of  productions  applied  per  cycle.  In  the  current 
implementation  this  parameter  is  (arbitrarily)  set  to  limit  this  mean 
to  10  productions  per  cycle.  As  the  nunber  of  productions  required  per 
cycle  approaches  this  limit,  performance  degrades.  This  degradation  is 
produced  by  making  productions  wait  multiple  cycles  before  applying  and 
forcing  certain  processess  (sequences  of  productions)  to  drop  out.  The 
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evidence  is  quite  clear  for  such  capacity  limitations  in  the  human  case 
( [[31] I Section  6.3)*  A familiar  example  is  the  problem  of  holding  a 
conversation  in  difficult  traffic.  As  the  amount  of  computation 
required  for  processing  traffic  information  increases,  less  capacity  is 
left  over  for  the  conversation.  The  AI  motivation  of  such  a limitation 
is  simply  that  the  limits  of  finite  processing  capacity  must  be 
respected  in  any  physical  machine  (whether  it  has  parallel  processors 
or  not) . 

Given  that  only  a small  number  of  prod'jctions  will  be  allowed 
to  apply  in  parallel,  it  becomes  important  to  have  some  way  of  deciding 
which  of  those  that  can  apply  are  most  relevant.  This  is  very  much 
like  the  problem  discussed  above  of  insuring  that  the  currently  most 
relevant  nodes  in  the  network  are  those  that  are  allowed  to  be  active. 

A solution  in  terms  of  strength  measures  is  also  adopted  in  this  case. 
Associated  with  each  production  is  a strength  reflecting  the  past 
success  of  that  production.  Details  of  how  this  strength  is  computed 
are  motivated  by  learning  considerations  and  so  have  been  omitted  from 
this  discussion.  For  present  purposes  it  is  important  only  to  note 
that  the  probability  that  a production  will  apply  on  a cycle  when  its 
condition  is  satisfied  depends  on  the  strength  of  that  production 
relative  to  the  strengths  of  all  the  other  productions  whose  conditions 
are  also  satisfied.  This  means  that  the  stronger  productions  (and 
hence  the  more  successful  processes)  tend  to  be  tried  first  and  are 
less  disturbed  by  processes  going  on  concurrently. 
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Consider  the  implication  of  these  strength  mechanisms  for 
processing  of  structural  ambiguity  in  language  where  competing  sets  of 
productions  are  responsible  for  different  interpretations  of  the  same 
linguistic  structure.  The  relative  frequency  of  the  two  structural 
interpretations  will  be  reflected  by  the  relative  strengths  of  the  two 
sets  of  interpretative  productions.  We  would  therefore  expect  that 
subjects  would  tend  to  interpret  the  sentence  according  to  the  more 
frequently  intended  interpretation,  but  that  they  could  retrieve  the 
other  interpretation  and  that  they  would  sometimes  choose  the  less 
frequent  interpretation  first.  Also,  we  would  expect  that  by 
bombarding  the  subject  with  examples  of  the  less  frequent 
interpretation  we  could  make  it  the  favored  interpretation  of  the 
ambiguous  structure.  All  these  implications  are  known  to  be  true  [[15]]. 
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Fcx)tnotes 


1.  Distribution  of  this  manuscript  and  current  research  on  the  ACT  model  are 
supported  by  ONR  contract  N00014-77-C-02'42. 

2.  It  has  to  be  pointed  out  here  that  there  is  still  considerable  ignorance 
about  the  capabilities  of  serial  computers  and  their  abstractions.  For  instance, 
while  many  problems  are  conjectured  to  have  exponent  time  functions  as  minimuns, 
no  natural  problem  has  been  shown  to  require  greater  than  n for  a 

E>0  [[1]]. 


[References] 


1.  Aho,  A.V.,  Hopcroft,  J.E.,  4 Ullman,  J.D.  [The  Design  and 

Analysis  of  Computer  Algorithms.]  Reading,  Mass.:  Addison- 
Wesley,  ^97'^. 


2.  Anderson,  J.R.  Language  acquisition  by  computer  and  child. 
Technical  Report  No.  55,  Human  Performance  Center,  197*4. 


3.  Anderson,  J.R.  [Language,  Memory,  and  Thought].  Hillsdale,  N.J.: 
Lawrence  Erlbaun  Associates,  W6. 


*4.  Anderson,  J.R.  and  Bower,  G.H.  [Hunan  Associative  Memory.] 
Washington,  D.C.:  V.H.  Winston,  1973. 


5.  Anderson,  J.R.,  Kline,  P.  and  Lewis,  C.  A production  system  model 
for  language  processing.  In  P.  Carpenter  and  M.  Just  (Eds.) 
[Cognitive  Processes  in  Comprehension.]  Hillsdale,  N.J.: 
Lawrence  Erlbaun  Assoc.,  in  press 


6.  Anderson,  R.C.  Substance  recall  of  sentences.  [Quarterly  Journal 
of  Experimental  Psychology],  [26],  197*4,  530-5*41  . 


7.  Baddeley,  A.D.  and  Hitch,  G.  Working  memory.  In  G.H.  Bower  (Ed.) 

[The  Psychology  of  Learning  and  Motivation],  [8],  197*4,  New 

York:  Academic  Press. 


8.  Sever,  T.G.,  Fodor,  J.A.,  and  Garrett,  M.  A formal  limitation  of 
assoc iationian.  In  T.R.  Dixon  and  D.L.  Horton  (Eds.)  [Verbal 
Behavior  and  General  Behavior  Theory].  Englewood  Cliffs,  N.J.: 
Prentice-Hall,  1968. 


9.  Chase,  W.G.  and  Simon,  H.A.  The  mind's  eye  in  chess.  In  W.G. 

Chase  (Ed.),  [Visual  Information  Processing].  New 
York:  Academic  Press,  1973. 


23 


10.  Chomsky,  N.  Verbal  behavior  (a  review  of  Skinner's  book). 
[Language],  [35],  1959,  ?6-58. 


11.  Collins,  A.M.  i Loftus,  E.F.  A spreading-  activation  theory  of 
semantic  processing.  [Psychological  Review],  [82],  1975,  ^07- 

428. 


12.  Collins,  A.M.  i Quillian,  M.R.  Experiments  on  semantic  memory 
and  language  comprehension.  In  L.  Gregg  (Ed.)  [Cognition  and 
Learning].  New  York:  Wiley,  1972. 


13.  Crowder,  R.G.  Behavioral  strategies  in  immediate  memory. 

[Journal  of  Verbal  Learning  and  Verbal  Behavior],  [8],  1969, 
524-S28. 


14.  Davis,  R.  and  King,  J.  An  overview  of  production  systems. 
Computer  Science  Department,  Stanford  University,  1975. 


15.  Fodor,  J.A.,  Bever,  T.G. , and  Garrett,  M.F.  [The  Psychology  of 
Language].  New  York:  McGraw-Hill,  1974. 


16.  Fredericksen , C.  Effects  of  context- induced  processing 
operations  on  semantic  information  acquired  from  discourse. 
[Cognitive  Psychology],  [7],  1975,  139-166. 


17.  Johnson,  D.M.  [A  Systematic  Introduction  to  the  Psychology  of 
Thinking].  New  York:  Harper  and  Row,  1972. 


18.  Kieras,  D.E.  Finite  automata  and  S-R  riiodels.  [Journal  of 
Mathematical  Psychology],  [3],  1976,  in  press. 


19.  Kieras,  D.E.  Problems  of  reference  in  text  comprehension.  In  P. 

Carpenter  and  M.  Just  (Eds.)  [Cognitive  Processes  in 
Comprehension].  Hillsdale,  N.J.:  Lawrence  Erlbairi  Assoc.,  in 
press. 


20.  Kiss,  G.R.  A test  of  the  word  selection  model  using  multiple 
stimuli  in  word  association.  Paper  presented  at  the  conference 
of  the  British  Psychological  Society,  London,  1967. 


24 


21.  Kline,  P.  and  Anderson,  J.R.  The  ACTE  User's  Manual.  Dept,  of 
Psychology,  Yale  University,  1976. 


22.  McDermott,  J.,  Newell,  A.,  and  Moore,  J.  The  efficiency  of 
certain  production  system  implementations.  Dept,  of  Computer 
Science,  Carnegie  Mellon  University,  Sept.,  1976. 


23.  Meyer,  D.E.  A Schvaneveldt , R.W.  Facilitation  in  recognizing 
pairs  of  words:  Evidence  of  a dependence  between  retrieval 
operations.  [Journal  of  Experimental  Psychology],  [90],  1971, 
227-23‘i. 


2^.  Minsky,  M.  [Semantic  Information  Processing].  Cambridge,  Mass.; 
The  M.I.T.  Press,  1968. 


25.  Newell,  A.  Remarks  on  the  relationship  between  artificial 
intelligence  and  cognitive  psychology.  In  R.B.  Banerji  and  M.D. 
Mesarovic  (Eds.),  [Theoretical  Approaches  to  Non-Numerical 
Problem  Solving].  Berlin:  Springer-Verlag , 1970. 


26.  Newell,  A.  and  Simon,  H.  [Human  Problem  Solving].  Englewood 
Cliffs,  N.J.:  Prentice-Hall,  1972. 


27.  (Juillian,  M.R.  Semantic  memory.  In  M.  Minsky  (Ed.)  [Semantic 
Information  Processing],  Cambridge,  Mass.:  MIT  Press,  1968. 


26.  Sachs,  J.  Recognition  memory  for  syntactic  and  semantic  aspects 
of  connected  discourse.  [Perception  and  Psychophysics],  [2], 
1967,  437-UM2. 


29.  Thompson,  R.F.  [Foundations  of  Physiological  Psychology],  New 
York:  Harper  & Row,  1967. 


30.  Savin,  H.B.  and  Perchonock,  E.  Gratmatical  structure  and  the 
immediate  recall  of  English  sentences.  [Journal  of  Verbal 
Learning  and  Verbal  Behavior],  [4],  1965,  3*18-353. 


31.  Simon,  H.A.  [The  Sciences  of  the  Artificial].  Cambridge,  Mass.: 
MIT  Press,  1969. 


25 


32.  Wanner,  H.E.  Oi  remembering,  forgetting,  and  understanding 
sentences:  A study  of  the  deep  structure 

hypothesis.  Unpublished  doctoral  dissertation.  Harvard 
University,  1968. 


33.  Wanner,  E.  and  Maratsos,  M.  An  augmented  transition  network 
model  of  relative  clause  comprehension,  unpublished  manuscript, 
Harvard  University,  1975. 


3*^.  Winograd,  T.  Procedures  as  a representation  for  data  in  a 
computer  progran  for  understanding  natural  language.  [MIT 
Artificial  Intelligence  Laboratory  Project,  MAC-TR-84],  1971. 


35.  Woods,  W.A.  What’s  in  a link:  Foundations  for  semantic  networks. 

In  D.G.  Bobrow  and  A.  Collins  (Eds.),  [Representation  and 
Understanding:  Studies  in  Cognitive  Science].  New  York: 

Academic  Press,  1975. 


26 


4 Dr.  Mdrstial  J.  Farr,  Director 

Personnel  i Training  Research  Programs 
Office  of  Navy  Research  (Code  458) 
Arlington,  VA  2?217 


ONR  Branch  Office 
495  Suimer  Street 
Boston,  MA  02210 
Attn:  Dr.  James  Lester 


1 NR  Branch  Office 

1030  East  Green  Street 
Pasadena,  CA  91101 
Attn:  Dr.  Eugene  Gloye 


1 ONR  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  60605 
Attn:  Dr.  Chalres  E.  Davis 


1 Office  of  Naval  Research 
Code  200 

Arlington,  VA  22217 


1 Director,  Hunan  Resource  Management 
Naval  Amphibious  Sctiool 
Naval  Amphibious  Base,  Little  Creek 
Norfolk,  VA  23521 


1 Commanding  Officer 

U.S.  Naval  Amphibious  School 
Coronado,  CA  92155 


1 Chairman,  Leadership  i Law  Dept. 
Div.  of  Professional  Development 
U.S.  Naval  Academy 
Annapolis,  MC  21402 


1 Dr.  Jack  R.  Borsting 
Provost  ft  Acadanic  Dean 
U.S.  Naval  Postgraduate  ScIkx)! 
Monterey,  CA  93940 


1 Commanding  Officer 

Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 


1 LCDR  Charles  J.  Theisen,  Jr. 
MSC,  USN 
4024 

Naval  Air  Development  Center 
Warminister,  PA  18974 

1 Commanding  Officer 

Naval  Health  Research  Center 
San  Diego,  CA  92152 
Attn:  Library 


1 Scientific  Advisor  to  the  Chief 
of  Naval  Personnel  (Pers  Or) 
Naval  Bureau  of  Personnel 
Room  4410,  Arlington  Annex 
Washington , DC  20370 


1 Mr.  Maurice  Callahan 
NODAC  (Code  2) 

Dept . of  the  Navy 

Bldg.  2,  Washington  Navy  Yard 

( Anacostia) 

Washington,  DC  20374 


1 Office  of  Civilian  Personnel 
Code  263 

Washington,  DC  20390 


1 Superintendent  (Code  1424) 
Naval  Postgraduate  School 
Monterey,  CA  93940 


1 Mr.  George  N.  Grjine 

Naval  Sea  Systems  Command 
SEA  047012 

Washington,  DC  20j62 


1 Prinicipal  Civilian  Advisor  for 
Education  ana  Training 
Naval  Training  Command , Code  OOA 
Pensacola,  FL  32508 
Attn:  Dr.  William  L.  Maloy 


1 Chief  of  Naval  Education  and 
Training  Support  (OlA) 
Pensacola,  FL  32509 


1 Navy  Personnel  R&D  Center 
Code  01 

San  Diego,  CA  92152 


5 A.  A.  Sjoholm,  Head,  Technical  Support 
Navy  Personnel  R&D  Center 
Code  201 

San  Diego,  CA  92152 


1 Capt.  D.  M.  Gragg,  MC,  USN 

Head,  Section  on  Medical  Education 
Uniformed  Services  Univ.  of  the 
Health  Services 
6917  Arlington  Ftoad 
Bfcthesda,  MD  20014 


1 Dr.  John  Ford 

Navy  Personnel  R4D  Center 
San  Diego,  CA  92152 


1 Dr.  Richard  A.  Poliak 
Academic  Computing  Center 
U.S.  Naval  Academy 
Annapolis,  MD  21402 


1 Chief  of  Naval  Technical  Training 
Naval  Air  Station  Memphis  (75) 
Millington,  TN  38054 
Attn:  Dr.  Norman  J.  Kerr 


1 Dr.  Alfred  F.  Smode,  Director 
Training  Analysis  & Evaluation 
Group 

Department  of  the  Navy 
Orlando,  FL  32813 


1 Capt.  H.  J.  (Connery,  USN 
Navy  Medical  R&D  Cormand 
NNMC,  Bethesda,  MD  20014 


1 Navy  Personnel  R&D  Center 
Code  306 

San  Diego,  CA  92152 
Attn;  Dr.  James  McGrath 


1 Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 
Attn:  Library 


1 LCDR  J.  W.  Snyder,  Jr. 

F-14  Training  Model  Manager 
VF-124 

San  Diego,  CA  92025 


1 Dr.  Worth  Scanland 

Chief  of  Naval  Education  & 
Training 

NAS,  Pensacola,  FL  32508 


1 Technical  Director 

U.S.  Army  Research  Institute 
for  the  Behavioral  and 
Social  Sciences 


I 1 Armt<i  Forces  Stoff  College 

Norfolk,  VA  23511 
' At,tn:  Library 


5001  Eiserihower  Avenue 
Alexondriri , VA  22333 


1 Commandant 

U.S.  Army  Infantry  Cchool 
Fort  Denning,  CA  31905 
Attn:  ATP.H-I-V-IT 


1 Commandant 

U.S.  Array  Institute  of  Administration 
Attn : EA 

Fort  Benjamin  Harrison,  IN  U6216 


1 Dr.  Frank  J.  Harris 

U.S.  Army  Kesearch  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


1 Dr  . Le-on  Nawi  ocki 

U.S.  Army  Research  Institute 
5001  Eisenfiower  Avenue 
Alexandria,  VA  22333 


1 Dr.  Milton  S.  Katz,  Qiief 

ItidiVidual  Training  and  Performance 
Evaluation  Tecnnical  Area 
U.S.  Army  Research  Institute 
5U01  Eiseritower  Avenue 
Alexandria,  VA  22333 


1*  DCDR,  USAADHINCEN 
Bldg.  //I,  A310 
Attn:  AT21-0ED  Library 
Ft.  Benjanin  Harrison,  IN  ^6216 


1 Dr.  Beatrice  Farr 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue. 
Alexandria,  VA  22333 


1 Dr.  Ralph  Dusek 
U.S.  Army  Research  Institute 
5001  Eisenhower  avenue 
Alexandria,  VA  22333 


1 Dr . Joseph  Ward 

U.S.  Army  research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


1 HQ  USAREUE  A 7th  Army 
CDCSOPS 

USAREUR  Director  of  GED 
APO  New  York  09403 


1 ARl  Field  Unit  - Leavenworth 
P.O.  Box  3122 

Ft.  Leavenworth,  KS  56027 


1 Dr.  JamtS  Baker  1 Research  Branch 

U.S.  Army  Research  Institute  AFMPC/DPMYP 

5001  Eisentiowtr  Avenue  Randolph  AFB,  TX  7P14P 

Alexandria,  VA  22333 


1 AFHRL/AS  (Dr.  G.  A.  Eckstrand) 
Wright-PaLterson  AFB 
Ouo  U5433 


1 Dr.  Marly  Rockway  (AFHRLyTT) 
Lowry  AFB 
Colorado  80203 


1 Dr.  Alfred  R.  Fregly 
AFOSR/NL,  Building  ^^0 
Bolling  AFB,  DC  20332 


1 Air  University  Library 
AUL/LSE  76-^443 
Maxwell,  AFB,  AL  36112 


1 Dr.  A.  L.  Slafkosky 

Scientific  Advisor  (Code  RD-1) 
HQ,  U.S.  Marine  Corps 
Washington,  DC  20380 


1 Mr.  Joseph  J.  Ck)wan,  Chief 
Psychological  Research  Branch 
(G-P-1/62) 

U.S.  Coast  Guard  Headquarters 
Washington,  DC  20590 


1 Dr . Robert  Yoing 

Advanced  Research  Projects  Agency 
1400  Wilson  Blvd. 

Arlington,  VA  22209 


1 Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 
Research  4 Engineering 
Room  3D129i  The  Pentagon 


1 Dr.  Ross  L.  Morgan  (AFHRL/ASR) 
Wright-Patterson  AFB 
Ohio  45433 


1 Instructional  Technology  Branch 
AFHRL 

Lowry  AFB,  CO  80203 


1 Dr.  Sylvia  R.  Mayer  (MCIT) 
HQ  Electronic  Systems  Division 
LG  Hanscom  Field 
Bedford,  MA  01730 


1 Director,  Office  of  Manpower 
Utilization 

HQ,  Marine  (Jorps  (ODde  MPU) 
BCB,  Building  2009 
Quantico,,  VA  22134 


1 AC/S,  Education  Programs 
Education  Center,  MCDEC 
Ojantico,  VA  22134 


1 Dr.  Harold  F.  O'Neil,  Jr. 

Advanced  Research  Projects  Agency 
Cybernetics  Technology,  Room  623 
1400  Wilson  Blvd. 

Arlington,  VA  22209 


12  Defense  Docunentation  Center 
Camion  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn : TC 


1 Director,  Management  Information 
Systems  Office 
OSD,  M4RA 

Room  3B917,  The  Pentagon 


Washington,  DC  20301 


Washington,  DC  20301 


Dr.  Venn  Urry 
Personnel  R4D  Center 
U.S.  Civil  Service  Cctnmision 
1900  E Street  NW 
Washington,  DC  20415 


Dr.  Marshall  S.  Smith 
Associate  Director 
NIE/OPEPA 

National  Institute  of  Education 
Washington,  DC  20208 


Dr.  Scarvia  B.  Anderson 
Educational  Testing  Service 
Suite  1040 

3445  Peachtree  Road  NE 
Atlanta,  GA  30326 


Dr.  Robert  K.  Branson 
1A  Tully  Bldg. 

Florida  State  University 
Tallahassee,  FI.  32306 


Century  Research  Corp. 
4113  Lee  Highway 
Arlington,  VA  22207 


Dr.  Norman  Cliff 

Dept,  of  Psychology 

University  of  Southern  California 

University  Park 

Los  Angeles,  CA  90007 


1 Dr.  Andrew  R.  Molnar 

Scientific  Education  Dev.  & 
Res. 

National  Science  Foundation 
Washington,  DC  20550 


1 Dr,  Joseph  L.  Young,  Director 
Memory  & Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


1 Professor  Earl  A.  Alluisi 
Code  287 

Dept,  of  Psychology 
Old  Dominican  University 
Norfolk,  VA  23508 


1 Dr.  Jo^ln  Seeley  Brown 

Bolt  Berenek  and  Neuman,  Inc. 
50  Moulton  Street 
Cambridge,  MA  02138 


1 Dr.  Kenneth  E.  Clark 

College  of  Arts  & Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  14627 


1 Dr.  Allan  M.  Collins 

Bolt  Berenek  and  Newman,  Inc. 
50  Moulton  Street 
Cambridge,  MA  02138 


1 


Dr.  John  J.  Collins 
Essex  Corporation 
201  N.  Fairfax  St. 
Alexandria,  VA  2231 


1 Dr.  John  D.  Carroll 
Psychometric  Lab 
Davie  Hall  01 3A 
University  of  North  Carolina 
Chapel  Hill,  NC  27514 


1 Dr.  Ruth  Day 
Center  for  Advanced  Study 
in  Behavioral  Sciences 
202  Junipero  Serra  Blvd. 
Stanford,  CA  94305 


1 ERIC  Facility-Acquisitions 
4833  Rugby  Avenue 
Bethesda,  MD  20014 


1 Commanding  Officer 

Canadian  Forces  Personnel 
Applied  Research  Unit 
1107  Avenue  Road 
Toronto,  Ontario,  CANADA 


1 Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 


1 Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organization 
8555  Sixteenth  Street 
Silver  Spring,  MD  20910 


Dr.  John  R.  Frederiksen 
Bolt  Berenek  and  Nennan,  Inc. 
50  Moulton  Street 
Cambridge,  MA  02138 


1 Dr.  Vernon  S.  Gerlach 
College  of  Education 
146  Payne  Bldg.  B 
Arizona  State  University 
Tempe,  AZ  85281 


1 Dr.  M.  D.  Havron 

Hunan  Sciences  Research,  Inc. 
7710  Old  Spring  House  Road 
West  Gate  Industrial  Park 
McLean,  VA  22101 


1 HumRRO/Western  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 
Attn:  Library 


1 Dr.  Robert  Glaser,  Co-Director 
University  of  P 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 


1 CDR  Mercer 

CNET  Liaison  Officer 
AFHRL/Flying  Training  Div. 
Williams  AFB,  AZ  85224 


1 Dr.  Lawrence  B.  Johnson 

Lawrence  Johnson  & Associates, 
Inc. 

Suite  502 

2001  S Street  NW 

Washington,  DC  20009 


1 Dr.  Arnold  F.  Kanarick 
Honeywell,  Inc. 

2600  Ridgeway  Pkwy. 
Minneapolis,  MN  55413 


1 Dr.  Steven  W.  Keele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  97403 


1 Dr.  Robert  R.  Mackie 

Hunan  Factors  Research,  Inc. 
6730  Corton  Drive 
Santa  Barbara  Research  Park 
Goleta,  CA  93017 


1 Dr.  Leo  Munday 

Houghton  Mifflin  Co. 

P.  0.  Box  1970 
Iowa  City,  lA  52240 

1 Mr.  A.  J.  Pesch,  President 
Eclectech  Associates,  Inc. 
P.  0.  Box  178 
N.  Stonington,  CT  06359 


1 R.Dir.  M.  Rauch 
P II  4 

Bundeaninisteriun  der  Verteidigung 
Postfach  161 
53  Bonn,  1,  GERMANY 


1 Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  MW 
Washington,  DC  20007 


1 Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 
University  of  Missouri-Colunbia 
12  Hill  Hall 


1 Dr.  Roger  A.  KaufVnan 
203  Dodd  Hall 
Florida  State  University 
Tallahassee,  FL  32306 


1 Dr.  David  Klahr 
Dept,  oof  Psychology 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 


1 Dr.  William  C.  Mann 
University  of  So.  CA 
Information  Sciences  Institute 
4676  Admiralty  Way 
Marina  Del  Rey,  CA  90291 


1 Dr.  Donald  A.  Norman 
Dept,  of  Psychology  C-009 
University  of  California 
La  Jolla,  CA  92093 

1 Mr.  Luigi  Petrullo 

2431  N.  Edgewood  Street 
Arlington,  VA  22207 


1 Dr.  Joseph  W.  Rigney 

University  of  So.  California 
Behavioral  Technology  Laboratories 
3717  South  Grand 
Los  Angeles,  CA  90007 


1 Dr.  Leonard  L.  Rosenbaun, 
Chairman 

Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 


1 Dr.  Robert  J.  Seidel 

Instructional  Technology  Group, 
HumRRO 

300  N.  Washington  St. 


Coiuinbic,  MO  65201 


1 Dr.  Hichard  Snow 
Stanford  University 
School  of  Education 
Stanford,  CA  9*1305 


1 Dr.  K.  W.  Uncapher 
University  of  So.  California 
Information  Services  Institute 
4676  Admiralty  Way 
Marina  Del  Rey,  CA  90291 


1 Dr.  Carl  R.  Vest 

Battelle  Memorial  Institute 
] Washington  Operations 
2030  M Street  flW 
Washington,  DC  20036 


1 Dr.  Keith  We scour t 
Dept,  of  Psychology 
Stanford  University 
Stanford,  CA  9**505 


1 Dr.  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 


1 Prof.  Funiko  Samejima 
Dept,  of  Psychology 
Austin  Peay  Hall  304C 
University  of  Tennessee 
Knoxville,  TN  37916 


1 Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
6000  Jay  Street 
Sacramento,  CA  95819 


Alexandria,  VA 


1 Mr.  Dennis  J.  Sullivan 

c/o  Canyon  Research  Group,  Inc. 
32107  Lindero  Canyon  Road 
Westlake  Village,  CA  91360 


1 Dr.  Benton  J.  Underwood 
Department  of  Psychology 
Northwestern  University 
Evanston,  IL  60201 


1 Dr.  David  J.  Weiss 
Dept,  of  Psychology 
N660  Elliott  Hall 
University  of  Minnesota 
Minneapolis,  MN  55**55 


1 Dr.  Anita  West 
Denver  Research  Institute 
University  of  Denver 
Denver,  CO  80201 


1 Dr.  Thomas  G.  Sticht 

Assoc,  Director,  B^lsic  Skills. 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 


1 Dr.  Meredith  Crawford 
5605  Montgomery  Street 
Chevy  Chase,  MD  20015 


1 Dr,  James  Greeno 
Learning  RAD  Center 
University  ofPittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 


1 Dr.  Frederick  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90^06 


1 Dr.  Walter  Schneider 
Dept . of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 


1 Dr.  Robert  .Sternberg 
Dept,  of  Psychology 
Box  11a  Yale  Station 
Yale  University 
New  Haven,  CT  06520 


1 Dr.  Richard  B.  Millward 
Dept . of  Psychology 
Hunter  Lab 
Brown  University 
Providence,  RI  82912 


